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PACKAGED CUSTpWBR TRAILING 



Digital 's Educational Services Department has been developing 
individual ized, self*paced training packages since 1975. These 
' packages are designed to teacb users to operate their systems 
without requiring the presence of a Digital instructor, we have 
fDund, however, that the use of packaged training at custpmex 
sites presents two new problems of*its,own: 

' \- , * ' . . ^ h * * 

• it is difficult to co'ntrol the use of' these ^ , 

. ...packages on customer , sites as well" as we can 
' ' control them in Digital facilites, and 

^ it it is difficul/e to get accurate feedback^ on the 
strengths ana weaknesses of these packages from 
' ou^ customers. 4|t 

^ ' - ' , / ' . 

Digital/s Computer*-Base^ Cdurse Development GTffup is^addressing 
^ these problems by wr itiing computer -managed instructional (CMI). 
Materials tOi^run underJseveral o£ odr operating systetas. These 
CMI material^ -use customers'^ computers themselves to conjtrol 
their learn/ng and collect data that ye can use to assess the 
effectiveness' df the trairiing^packages. / 

' -This paper describes a computer-managed instructidn^ progr^ that 
-we have developed which is coupled with a new self-paced training 
^ package^ - - 

'•-*•*' . ' , * 

CMI m A CUSTOMER ENVIRONMENT 

' 'Infceractionfietween CMI 'arid Trainti^q PaPkages 
: — ^ » 1 7 

Digital ' s self -paced training packages are wr itt^ in a modular 
format. The modules are arranged in k speqiiflc learning hierar- 
chy, based on the prerequisite relationships of their objectives. 
Each mpdule contains a list of itSs objectives^ text and diagrams 
' to help ;learnei:s mastj^r these o bieot ives* and exercises ^ to be 
'per'forme'd "'both on paper* and on computer system. Each module 
' 9ls9/ has a related module test. The*' item banks f oi: the module 
t€fst^ are all stored on-lin^. . ^ ^ 

Before ^learners begin vork on thettraining package, they take the 
pre test for\the first module interactively a? a computer terminal 
Tsee .Figure 1-) . 'If they can demohstrate mastery on this test, 
the 'CMI/ system branches thent to the protest for the nexj? module^ 
in the hierarchy." This. loop conljinues until the learners come to' 
a te^t oji which they dannpt demons1;rate maste^ry. At this ;point,/ 
'they ^*re\directed to study thati module off-line, and return to 
the CMI By&jtem when they are ready for, the gosttest* 
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Jake PREtast 
for a module 



Take PREtest 
fornext modula 




* 


NO 






Study module 


and do exaroisas 







YES 



Print report and mail 

to Ojgttal Jor Diploma 

■ ^ 



Take POSTtest 
for this module 




Figure 1 

IWff^CTIOJl BETWE'BN ON-LINE CMI * ■ 
SXCTEM AND OFP-rLINE TRAINING PACKAGE 
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An important quality of the CMI approach is that it g^ts users 
on-lltie as soon as ^ possible and therefore has a definite 
Hawthorne Effect UJ. In the past^ customers often just sfUpped 
the tests that wer6 included in our tjcaining packages, because 
they felt (erroneously) that testing benefits only the teacher. 
It is difficult, if not impossible, to change this feeling, but 
we can capitalize on the Hawthorne Effect to get more * of our 
customers to take the. tests. The directions for running the CMI 
system are provided in *the trailing in cookbook terms, so that 
even - the' most inexperienced of out. users can get the programs on 
the^air. ' ^ ^ 

Gejieral CMI Characteris.tics 

* 

The CMI registration program allows users to register themselves 
interactively. It records their first and last' names (making 
sure that each is unique) and their addresses. 

Users then select a code name by which they will identify them-- 
selves in fut^ure logins to protect the confidentiality of the 
data that is stored on their work. This program also allows 
lasers to vi' 
ther course. 



r users to view the status of their work on each of the modules in 



The CMI test administration program presents true/false, yes/no, 
and multiple choice items (with eitKer four or five alter na^ 
tives) . These tests are generated interactively in real time. 
The items are randomly selected from item banks that are catego- 
r ized/B^ module and objective^ A typical item display is shown 
in figure^ 2» « . 

^ae system) IS highly human-engineered to makg it as foolproof as 
possible in a customer environment, F6r example, it provides the 
optiong^-^KIP", "QUIT"/ and ''REVIEW" as shown in Figure ^, and it- 
prov^aes "error" messages in plain English: if the user enters 
"g!/ in respohse to a true/false item^,,^ the system will print, 
"iaease enter only T, F, SKIP, ox QUIT^u It will ttien .erase the 
uper *s previous response and make room ;| for - him or her to enter 
lother one. ^ - . . ^ 



Jiven^tnat 



[1] "The Hawthprne Effect, which was given^that label b,ecause .it 
was first recognized in a study iftade at the Hawthorne, 
Illinois, pj^t of Western ElectriS C^ompany, is the tendency 
of subjmrrs^in some experiments to ^ respond the* almost an y 
kind ofjcharige, apparently due to a feeling of appreciation 

- — that someone is paying ■ attention to thdto. " (Biehler, 1971). 
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HULTIPL^ choice/ Type the l&ttir of the slterru^tive that BEST 
3r>5wer3 the Question or comj^letes the sentence in the item belpwl ' 

T^*PG SKIP if aou don't knoM the answer (countedr^s incorrect)* 
Type QUIT if you roust terminate this Lest before it is completed* 
*rype ReyrEW if you ^ould like to see the previous test item esain**" 
Press ^ the RE^URH k^y sfter you type your ^ns^er* 

5* Uhen the follo^xn^ ststeme^t is ^xecutedr ^hich operation Mill be 
performed f i rdt'^ 



10 PRIWT <4*7J+5/2-l 



A. Z/2 . 
2-1 

0. C<&3(t7)+5 



'/our answer? 



J. 



1 Figure 2 

SAMPLE DISPLAY 0/ A'^ULTIBLE 
CHOICE ITEM PRESBNTED TO A STUDENT 



i 
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_THE^11ASTX_RY. DECISION MODEL 



Sequential Testing ^ 



ERIC 



[2] This^^^study /defines a Type I error as a false n^atiive error*,' 
which occurs when a true master, is clafsi&lfied as "'a nonr 
master by the test. A Type II error is defined as a false 
positive error which occurs when a true non^master is clas^ 
sified as a master. . ^ " • . ■ *• , V 

■ > ^ ■ ' ■ 



y 



Even .with a considerable Hawthorne Effect, jcuBtomers still do not 
^ like to be tested. (There is always scyneone in every customer , 
Straining course who will say, "I paid my "iftoney to be taught, ,noJt 
testedl ") It is therefore important to keep t)|j^e length of the 
module ""tests as short Ss possij^le. 'It is useless, however, to 
make these tests so short that th^ir reliability approaches zero. 

Since 1974, all courses developed by Digital *s Educational 
Services Depar tment have t>een developeti — using a cr iter io>n- , 
referenced philosophy . This philosophy is especially applicable 
to industrial training, because* we are interested in individual 
perfoi:1!»anc& rather than a comparison between learners." We thjerfe^ 
fore required the CMI system to apply. this philosophy as well. 

Through an examination of educational literature (Heines, 1S75) ' 
we found that the most highly' dj&veloped cfiteribn-ref e^renced 
decision module that takes advantage of tfie capabilities 6f 
interactive .computing i0 one developed by Richard -Ferguson 
( 1971) . Ferguson ' s model *is ba^sed on Wald * s sequential „ 

^probability test ratio (WaldV 1947). This model allows tyto 
Criterion scores Jto be defined, P0^ and PI. ^Both of these scores 

w^re expressed in terms of percentages of correct responses* 

^ Learners whosa' scores are greater than P0 are classified as 
mastery, and learners whose scores are l^&s that -M^j^e classic 
fied as non-masters. Learners whose scores fall bertween P0 and \ 

' Pi are presented with another item. ' . ^ , - 

This model also takes into account the probability with wl)ich the - 
test iJeveloper is willing to allow Type I ( false, liegative) and 
Type II (false positive) errors to occur [2]* Let us define A as 
the probability that a Type I error will occur an^^ B 9s the 
probability that a Type II error^will occqr^ ;^he/test' BTeveloper, 
> can then assign values -to P0, PI, A, and B to determine* the 
learners* mastery state to any* d^tsTrecT degree "[^of, accuracy . ^ , , 
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Computations . . " 

Ferguson's secrinq^-l<3or-ithin-J.s^jdesjL_qn ed f or'^e sts in whlch^ the 
probability of getting an item cojcrect by guessing is~^pKe~satne" 
fo£ all items. Since the CMI system /^resents truie/false/'yes/no, 
and four- apd f ive-alte/^native mijli-iple choice items, which^ have 
vatyihg, probabilitie-s of ^gettipg them corject by guessing, the, 
algorithm must be modified . Each item is thetef or? assigned a 
weigh.ti'Wi according to the formiila: ' ^ , " 



where P is the probability of getting the item " cor-fect 6y 
guessing. t)sing this f ormula# true/false and yes/no items are 
assigned a weight of .25/. 50 or 0.50. Pour-alterftatlve multiple 
choice items are assigned ^ weight of . 25/.. 25 or 1.0, and f ive- 
alterhative multiple choice. items a weight of .25/. 20 or 1-.25. 

.After each test ^item is administered, the student's? score,, S is 
competed using the formula: ^ ^ 

5 = C X log(^l/P0) + (T-C) X log({l-Pl)/d-P0)) ^ 

ih^here C" is the ^um of the weights of the items answered correct- 
ly # anB t is the sum of the weights of all items t^t have been 
present^J; (ThuSr T-C is the sum of .the, weights of the items 
answered . incorrec'tly . ) * ' ' 

The student is classified as a master' and testing is terminated 

if - ' ■ • ... 

' '• ■ • . • . 

, S < lDg{B/{"l-A) ) ' . , , ' . 

• * # 

and at least one item has^ been presented on each objective" in the 
mpdple. If. the above inequality is true but all objectives have 
not bfeen tested , another item is presented. The stpdent -is 
classified as a non-master -nand' testing is terminate^, if 

S > log( (l-BV/A) . ' , 
' , \ 

regardless of the number of iteins *Rresent$d. on each, 0bjective. 
neither of these inequalities is true, that is, if 

, ' log(B/(l-A)0 < S < log((l-BV/A). ■ 

another test item is presented.. The^ ^system continues in this 
banner unjtil . one of the first two inequalities becomes true or 
until 30 /items have been administered. If no decision xan be 
made aft^r^ 30; items; the system classifies the student based on 
tfe ' differences between his or her' score and the two criteria. 
Trie stuc^ent is claa^if ied in the categpry whose criterion score 
is closest t9 his or her, computed score after 30 itents." 
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IMPLEMfJNTATION 



Test Paratne'ters 



I 



As* mentioned previously^ the GMI system generates both ^^re tests . 
and posttests. For thi& reason, it is important to realize .that^ 
the seriousness of making Type I arW Type II errors is different 
on pretests and posttest^. lf^tnie~syB^teifl makes a Type II (false * 
positive) error on a pretest, it will tell a student who h^ not^ 
studied the corresponding module to skip instruction th^c he or 
she really needs. This same error on a postfcest is not -as ^seri- 
ous, because the sti^ept will have already studied the module at;^ 
least/ once, and one can assume .that at least some minimal learn- 
ing has talcen place. A T^pe I (false negative) error is n&yer as 
serdous as a Type II error, because this situation dimply asks a 
student to repeat dnstriiction that he or-, she /does Rot really 
need, this wastes some trdme^ but one can Vsspme that it does ^not* 
decreaSe^the learner's proficieocy level. 



- Table 1 

SEQUENTIAL OjfeSTING PARAMETERS 
FOR .PRETESTS AND BOSTTESTS 



0i 



' '. parameter * 


Yor 
Pretests 


For ' 
Posttes^ 


Mast?r<y criterion (P0r , 
Non-m§stery criterion (PI)/, ^ 
^ Probability of Type I error (A) 

Probability of Type II error (B)* ^ 


0/65 

0.058 

0.025' 

% 


0.85 ' 

0.60 

0.104 

• a. 050 ;' 



' ... ' . ^ 4 

To take the relative . impo*rtance of these errojcs into considera-, 
tion^ the*-CMI system uses the parameters' shown in Table 1. These 
par^ameters were chosen for the following reason^s . Firsts the*, 
pretesfe, and- posttest -mastery and non^mastery *criteria vere set to 
span the percentage score of 70-80% that most criterion-refer- 
encj&d tests use as a TPaste.ry level' when only one cutting score is 
employed.* Second, the mastery criterion for pretests was /in-^ 
creaseH §% .over that for posttests to reflect a sligljtly more, 
stringent criterioii for mastery if a module has *not yet beeii> 
-studie*d. The non-mastery criterion for pretests was al^so ^i'rt* 
creased 5% to keep the differences between tligse two criteria', 
equal for bbth -types of tests. Thifs was neces'^sary beqause the' 
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difference 'between the two ^criteria is itself a factor in deter- 
mining test lengtb. As the difference increases,, the- numbed. j2^f 
test litems required vto make a decision, at any given level of 
certainty decreases. Conversely as the difference between t^e 
two percentage criterion levels decreases/ the number o^ required 
test> itenvs increases. 

Third, the allowable probabilities of Type'^I (false positive) 
errors were set to 0.025 ^nd 0.050, i;espectively , for pretests 
and posttests. The factor of 2- separating these Xpacamet^ers re- 
flects othe relative seriousness, of making this type of error on 
pretests versus its seriousness on posttests. That is,, it is 
estimated -that the seriousness of making a Type II er*ror ^n a 
pretest is twice as great as that on a posttest, so .the allowable'' 
probability of this error on pretests was decreased by a farbtor 
of 2. Finally , the probabilities o5 Type I (false negative) 
errors were <3erived by computing the highest' value that would 
still require at least three items, to be presented before a, non- 
mastery decision is made > unless the first two items are both 
\ fiv^-al tentative multiple choice items (with a weight oC^l. 25l 
*each). '.The three item consideration was conceived because it w^t? 
. felt that students >ould , distrust the system if they were judged 
non-masters after only fwo item^ had been presented. 



The magni^tudes of fcie error* probabilities also warrant some 
discussion. Fetguson (ld7JL) allov^ed probabilities of 0^ 20 and 
0:U0/ respectively , for his Type I and Type^ II errors. These 
^values reflect the same 2:1 ratio .to be used' in* ^his^^study , but 
'their* ^nagditudes 'are approximatejLy twice those pf the onfes Used 
in th^^s stu<3y* The main reason for selecting Isower probabilities 
is - that Fergusbn*s testing unit va& the objective, while* the 
current. studyV^testing unit is the modul^^ (a group ot up to 20 
, Ob jectives) . It' was felt that when working on the module leviel, 
the corfSequences ^of -errors of classification' are more' ^feripus* 
>^han at the lower obje9tive levei?* Thu^, the^bs^olute values of 
zhe allowable error probabilities ^re' lowered . 

I - m 

To see hpw these parameters reflect the mastery decision mojt^el in 
terms of raw scores, Prefer to' Figure J'i9ure 3q §how^ a graph 
oE, the protest decision rulesv while Fijwr^^b shows^ the, posttest 
dec^i^ion rules., , *Note the "difference the sizes of the two 
ma^ster areas ana the specif ifc points/ labe*ille4. ""The point label-^ 
led "(2.5,0)" in both, graphs indicates thVt-^e earliest' that a 
- non-master decision could be rtia^*e on ^it^er t^st ia a'fter the- siim^ 
of the ^ weights of a^l items presented totals at le^st 2.5* Sf / 
at this tinre, the student has not answered a^y ;itemg; correctly , 
t?e or 5he will be classified as' a hoh-mastgiT; ' ■ > 



In Figure 3a, the point labelled '* (li: 5,11^5^ " indi^cates that the 
earliest that a master decision could be made|on^ a pretest^is 
after litems having a tot^l- weight of Al* 5 have ,bjjeft' presettted and 
all items have been answered correctly. ,Con%^rast tJUs poifit with 
the one labyelled "(845,8.&)" in Figure 3b. The latter indicates 



■ 1 
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(30.0,30.0) 
(30.0,26.5) 

(30.0,22.0) 



0' 2 iv 6 10 U 13 22 26 30 
SUtJI OF VJEIGH7S OF ALL TSlZ-IS PHSSSKTED 





(30.0,30.0) 



{30.0,2if.5) 



(30.0,20.0) 



pQ a 0*85 • 
fj_"*= 0.6o 
;.a =^Oaoi+ 
b a 0.050 
» . • 



0 2 iv 6 10 Ih. 13 22 26 30 
^SITA OF WBSGHTS' OF ALL ITEMS PRESEJJTSO 



S.' 



Figure 3 

"GR5KTB~DF"'TiJi; PRETEST' 
• AND ■POSl'TEST DECISION RULES 
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that the Earliest l:hat master d^^ision , could be made on a 

gosttest ■ is after items* having a total weight of at ifeast 8*5 
avfe ^een presented and answered* -correctly. Therefore^ the 
^osttest mastery cj: iter ion is Igss stringent than' the pretest^ 
mastery criterion. This relationship is exactly, thre <^e desired,^ 
because it reflects that an erroneous maste?^ decision on a po^- 
test is less s^ri^ous than VhaJb on a pretest. 



yne Question of jteliablllby 

, . . . ' 

The concept of criterion-referenced reliability as a measurie^of 
the consistency of mastery and ■ n6n»-mastery cl'assif iWtions ip one 
which has received considerable support ('Carver, 1970; Hambleto 
aT\d Novick, 19712; Livingston/* 1976; Subkovniafc, 1976; Curlette, 
'^19(J). "Such measures require two sets '.of test d-atal The fre- 
quencies ot- agreement be'tween the, classif /cation decisions made 
by both- sets of test data may then be represented in a 2x2 table 
as shown in Figure -4. - , ' ■ ' * " 



CLAS^FI- 
CATIOT ON 
T,2 



' CLASSIFICATION ON Tl 

Master Master 
+ + + 

Master ■ ] a I c I ~ 

'f + 

Non-Master I b | d I 

+-"•:-+ 

% r 



* * Figure 4 

FREQUENCIES. OF AGREEMENT BETWEEN 
MASTERY AND NQN-MASTto CLASSIFICATIONS 
CD TWO 'SETS OF TilSiR DATA 



number of* students .who were'^classif ied 



In, this table, a is the 
ro ast er s o n b e ri i— Tl and T2, — amdr^-^iir S' th e n umb er - who vrere «l^s i- 
f ied -as non-masters on both tests* As these frequencies in- 
crease, thfe nrore ^ the * two sets of, data agree and th^ ' Ifi^her^ the 
reliability of classification* Conversely, b an^ c are the 
disagreement frequencies, and th'^^y increase The ^^I'fabiliJti^ of 




classification decreases. 
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Carver (1970) points out that; reliability: of classification does 
npt depend on score variability^ and is th^ref6re useful in 



assessing, the reliability of criter ion*referenced tests » 
simplest expression of a T^eliab'ility coefficient base'd on 
concept 'is the percentage of qases. in which both sets ^f 
agyee, namely: ^ ' 



The 
this 
data 




, This measurement varies betweeii 
^"percentage of agreement" • ^ 



0 and.l and is referred" to" as th^ 



.Swaminathan et al. (1974-) prefjer^ using a' reflKeipent of Vthe 
percentage of agreement known as the kappa^ coefficient,^ Thi;s 
expression attempts to correct the percentage x)^ agreement for 
\;;^chance; The computation is: * - , , 

kappa - 1 _ PC . \ . . ■ . ■ , , , 

where P0 is the percenta^^ of agreement^ ^an^ 

PC . is ■ (a+c) (a+b)t(b+d) (c4^) 
■ , ^ (aVh+c+K5)' * . ^" ' ; 

Swezey and P^rlsbein X13^'5) prefer a slightly more sophisticated 
expression called the pni coefficient! .This coefficient .is 
' .re:ally the correlation of two sets of test data using 0 as the 
non-itiastery scpire and 1 as t^e mastery score. The computation: , 



phi = 



ad - be 



V (\a+b) (ate) (b+d) (c+d) 



\ 



suffi- 
cient 



Swezey and Pe^rlst^in ^uggeet that, phi\>'0.5 represents 
clent .4reliabiHty" ^ while ' phi </^-^^ ?epresents« "Ansuffi 
reliability". Note that if b r c/ Ijappa ^ phi; > ' 

Livingston (1976) -analyzed these" comptttations and suggested^ yet *a 
fourth coefficient. His purp^ose wa^s. to modify the *simplV 
percei\tagj& of agreement, P0,^ feo that it va1^4e^ between rl and +1 
(likg the kappa and phi coefficients)^ .and to show tha^t this n^v* 
coefficient/ the G index^ mor^ logically reflects the reliability 
of classification. The c'&jAputat'ion is: 



(P(^. - 0.5) 



Two esfamples from Livingston' 9 work suffice to moke his point* 
Consider the data in Figure 5» ^Livingston argues that the data 
in- Case,l 'cleatly shoi/ ^hat, iii most cases, Tl ^and T2, do not 



J / 
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agree. Yet tlfe* kappa . and phi coefficients for .these data* are 
+0.12 an<S' +0.25r respectively ^ which are ^maill but definitely 
positive. The corresponding G index for t\\^ data^ in pase 1 is 
-0.20.r *which> Livingstoti ^tgues^ more accruately ^indicates the 
disagreement l?ecause* £t is neg^itive. . ' *i 



. Ca^^ 1 Tl * - 

+^^__+ ^ 

' M J 20 i . 60 I . 

T2 + + + 

N-M I- 0 1 2*0 I 



Case 2 ■ Tl 

M ■ N-M 
+ + ._+ 

M r '■ 90 I 5 I 



T2 



+- 
I 

+- 



+ T^— + 



0 



u — , + + 



Figure 5- 



'sampj.e' ci4ssificatiqn ^requencieiS 

■ 4 

(after^ Livingston/ 1976) » 



The data ih Case" "2 are ,even^inore stcikiogi .Tl and, T2 ^gree in 
90% of- the testing cases^ yet thg ka^pa*and phi coefficients are 
both -0. 05.^^ Ttie q^rtesponding 6 ihdesf is- 0.80^: Here ag^in^ 
Livingston argues^ the 6^ index' more^ aocurately reflects the 
correlation o't classification because it ,i^ positive. t 

This study assesses criterion-te£erenced, reliability a@ a relia- 
bility *of cljissiflcption using *the G index. The two sefts of test 
data used to assess bhis reliabili^ty ^ are the mastery decision 
made on the normal fvariable length) version of a test and that 
^&de on the same test' when . it Is extended to 30 Iti&ms. To do^ 
thiSr every f if test presented to a particular student^ is ex- 
tended to 30 iteiAs in length/ regardless of the test parameters^ 
When the scdring algorithm^ makes its ^initial decision/ a tenta- 
tive mast^ty classification is recorded. Ttie system continues 
presenting test items until the malcimum of 30 has. been presented^- 
at wbich time the final^master classification is recorde^d. -This 
daj:a is analyzed to ^determine the percentage of agr^embnt between 
the two classif ic^tionSf and th« 6 index will be computed, 
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. ■Closing the Feedback Loop . 

— r ^ — ' ^ *A 

x^The CM]C progralns are currently* impleniented on 4 number of 'differ- 
ent Di^it^ systems. For this reason ^ the media on which the CMI 

. ' U ' ■ ' . 
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programs are ^ distr ibuted' and on -which student response* data is 
st6red Varies greatly CTom system to system « The only common, 
media to these systems is pap^.j;, but many ,hav^ magtapes or floppy^ 
diskettes. After users complete the training package, and alT of* 
the module tests,, data on their work is copies t6^a magtape or, 
floppy diskette or printed on papei: 'and mailed back 'tb Digitals 
This data allows us to do complete criterion-r^f ereYiced item 
analysis on the users ' responses and check the status of the 
users on each^ module\ Users who complete the entire couf^e 
satisfactorily repeive a diploma .after their data is analyzed. 



FUTURE ENHANCEMENTS ^ * 



All of th& program's that ma^e up this CMI system aze written in a 
subset of the BAStC language* This makes them highly transpoi:- 
table to almost gll 'of Digital's operating systems* in addition, 
all of the CMI programs and data fil^s for about 81^10 .test items 
will fit on a single, dual-rdensity diskette (approximately 2501^ 
PDP*ir words) * * * . ^ ' 

These characteristics^ make the CMI system applicable tq^ internal'' 
and large systems trainings as well as small systems t^raining, 
because it is sniall^nough to fit on a diskette yet sophistic.ated 
enougtu to^ handle more and larger item banks ^ if additional disk 
space ig""available * Our future p^ans include expanding the t'yp'es 
of' *i.tems that the system and mastery algorithms can handle and 
improving the system's ability to accommodate courses with vary- 
ing structures* , * * * , 
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frequently ipvite and provoke reaction in the other two. pojrments 
and discussions aJx>ut French^language ii^struction were often, marked 
ty subtle though unmistakable political and religious overtones* 
Three areas of concern emerged "in this regard. 

Firsbi there was the- suggestion ty some that^the teaching 
of French in schools was priirarlly a concession to Fran(^e ai^ . 
French irrperialism; such^ a belief was. generally accompanied by a 
noticeable hostility toward France and the French language as well 
.;*as a f^ce carrndtment to be free of French influence in Canada* 

Second, sane individuals' regardeSa the teaching of Rrench 
as evidence of growing Quebec nalfionalism whichiirt their view, 
already influences disproportionately federal govemnent policies' 
in Canada, aM whicSi.^Could in t^svB^ elevate the French language to 
a status iTore prestigious than English or even, in f^ct, contribute 
to the disintegration of confederation such as it exists at 
present. ^ ^ 

Finailyi seme individuals expressed concern that the teaching 
of French was but a subtle xnschanism to extend the influence and 
power of the Reman Catholic Ghiirch in this country. As one 
individual sees^i "It's a sneaky way, of getting nore Catholics'*, i 

To suntnarize and qualify t it appear^ evident that often 
persons who fear or mistrust the inotives of Rrance, of Quebec# 
and/or of Pcmn Catholicism for whatever reasons are ii\ general 
most reluctant to support the teaching of French on any meaningful 
scale # and in sorre cases # on any scale whatsoever. These individuals. 
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seem to prefer the "melting pot" concept to the mosaic and often . 
view the Introduction and development of second language programs 
such as French as a source of weakness and disunity within the 
country. * ^ ' ^ 

By way of contrast # ther^ were a number of pec^le vAiose 
hesitancy to support French language instruction appeared to be 
rooted only in theic genuine concern fQr the continued existence 
and iirpXFvement of the English language an^ culture quite apart 
from questions of a religious or political nature. These individuals 
seemed somevihat skeptical that the French and English languages and 
cultures oould co--exist and indeed flourish together; to somei , , 
this situation r^resentsi^a delicate balance nearly impossible 
to achieve and to maintain witliin this vast and varied country. 

concerns of the sort delineated herein ' were not 
necessarily common to large groups of individuals in any given 
setting. Nonetheless, vihere^such issues emergedi there appeared 
to be considerable opposition to the teaching of French in general 
and, more particularlyi to the introduction of new and the expansion 
of already existing French-language programs. 



19 



■ - 18 - 

Ooriclusion 



As the above discussion suggests, the factors which may' 
inf Itience the degree of support or non-support for Freijch language 
programs are both varied and, conplex and the degree of / support 
for, Or opposition to, this kind of educational innovatiiDn is in many 
instances a function of the intensity of various constituents* 
cawictions with regard to program goals, posts, suil|^ility, 
outcomes and the like. Also, it was evident in the ^tudy that 
views held by many irafividuals, both those vAio suppdrt and tlK>se^ 
^Ak) oppose such programs7 l^^e frequmtly based not/on factual 
data about the instanictional model but rather on factors such as 
hearsay, hunches, suspicions and emotioi^. | 

While t^is latter^ issue poses a very critical problem to 

educators in terms of planning, iji^lementing and expanding Ptench- 

^ -* 

language programs in schools, the da^ about'sup^ort and non^support 

factprs gathered in this investigation will undoubtedly be of 

f 

benefit to these sams persons in terjns of anticipating difficulties 
and developing strategies to deal with them. This data may even 
sugg^t that under certain circumstances, the irpleamaitation l^t3/or 
developrent of certain French^language programs is premature, and 
should/ in fact, be delayed until a more receptive cliinate can be 
developed, assuming th^t such a development is both feasible 'and 
desirable. 
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